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IN THE CLAIMS : 

Tliis listing of claims will replace all prior versions, and listing of claims, in 

the Application. 

Listing of claims : 

1 . (Currently amended) A method of automatically identifying participants at 
a conference who exhibit a particular expression during a speech 
comprising th e st e ps of : 

receiving from a user input data which specifies i nd i cat i ng the particular 
expression during the speech : and 

identifying whether at least one participant exhibits the particular 
expression during the speech, said identifying including: 

analyzing data representing the participants to generate a set of 
action units (AUs) for each participant wherein each set of AUs for 
a participant represents an expression exhibited by the participant: 

determining whether at least one of the participants exhibits the 
particular facial expression bv processing each set of generated 
AUs utilizing an automated facial decoding system: and 

displaying, in response to determining that at least one of the 
participants exhibits the particular facial expression, the at least one 
participant to the user 

r e cord i ng th e partic i pants, th e r e cord i ng i nc l ud i ng both aud i o and v i d e o 
s iQin o l s' 
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d e t e rm i n i ng, us i ng tli e r e cord i ng of th e partic i pants i n conjunct i on w i tli an 
automat e d facial d e cod i ng syst e m, wh e th e r at l e ast on e part i c i pant 
e xh i b i ts th e part i cu l ar e xpr e ss i on; and 

i dent i fy i ng the at l east one part i c i pant who exh i b i ts the part i cu l ar 
express i on . 

2. (Currently amended) The method of Claim 1 wherein the recorded video 
and audio s i gna l s data representing the at least one participant is afe 
passed through a cultural r e g i ona l /cu l tura l filter to filter out expressions 
that are characteristic to a culture before the at least one participant is 
displayed to the user i d e nt i fi e d . 

3. (Currently amended) The method of Claim 2 wherein the recorded video 
and audio s i gna l s data representing the at least one participant is further 
afe passed through an individual filter to filter out expressions that are 
characteristic to the at least one participant before the at least one 
participant is displayed to the user i dent i fi e d . 

4. Canceled. 

5. Canceled. 

6. (Currently amended) The method of Claim [[5]] 3 wherein th e i d e nt i fy i ng 
step i nc l ud e s th e st e p of d i sp l ay i ng an i mag e as w ell as a name and 
location of the at least one participant i nd i v i dua l are also displayed to the 
user . 

7. Canceled. 
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8. (Currently amended) A computer program product on a computer 
readable medium for automatically identifying participants at a conference 
who exhibit a particular expression during a speech comprising: 

code means for receiving from a user input data which specifies i nd i cat i ng 
the particular expression during the speech : and 

code means for identifying whether at least one participant exhibits the 
particular expression during the speech, said code means for identifying 
including: 

code means for analyzing data representing the participants to 
generate a set of action units (Alls) for each participant wherein 
each set of Alls for a participant represents an expression 
exhibited by the participant: 

code means for determining whether at least one of the participants 
exhibits the particular facial expression by processing each set of 
generated Alls utilizing an automated facial decoding system: and 

code means for displaying, in response to determining that at least 
one of the participants exhibits the particular facial expression, the 
at least one participant to the user 

cod e m e ans for r e cord i ng th e part i c i pants, th e r e cord i ng i nc l ud i ng both 
aud i o and v i deo G i gno l G; 
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cod e m e ans for d e t e rm i n i ng, us i ng th e r e cord i ng of the part i c i pants i n 

conjunct i on w i th an automat e d facial d e cod i ng syst e m, wh e th e r at le ast 
on e part i c i pant e xh i b i ts th e part i cu l ar e xpr e ss i on; and 

cod e m e ans for i d e nt i fy i ng th e at le ast on e part i c i pant who e xh i bits th e 
part i cu l ar express i on . 

9. (Currently amended) The computer program product of Claim 8 wherein 
the recorded video and audio s i gnals data representing the at least one 
participant is afe passed through a cultural r e g i ona l /cu l tural filter to filter 
out expressions that are characteristic to a culture before the at least one 
participant is displayed to the user i d e nt i f ie d . 

10. (Currently amended) The computer program product of Claim 9 wherein 
the recorded video and audio s i gna l s data representing the at least one 
participant is further afe passed through an individual filter to filter out 
expressions that are characteristic to the at least one participant before 
the at least one participant is displayed to the user i d e nt i f ie d . 

11. Canceled. 

12. Canceled. 

13. (Currently amended) The computer program product of Claim [[12]] 10 
wherein th e i d e nt i fy i ng st e p i ncludes th e st e p of d i sp l ay i ng an i mag e as 
w ell as a name and location of the at least one participant i nd i v i dual are 
also displayed to the user. 

14. Canceled. 
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15. (Currently amended) An apparatus for automatically identifying 
participants at a conference who exhibit a particular expression during a 
speech comprising: 

means for receiving from a user input data which specifies i nd i cating the 
particular expression during the speech : and 

means for identifying whether at least one participant exhibits the 
particular expression during the speech, said code means for identifying 

including: 

means for analyzing data representing the participants to generate 
a set of action units (Alls) for each participant wherein each set of 
Alls for a participant represents an expression exhibited by the 
participant: 

means for determining whether at least one of the participants 
exhibits the particular facial expression by processing each set of 
generated Alls utilizing an automated facial decoding system: and 

means for displaying, in response to determining that one of the 
participants exhibits the particular facial expression, the at least one 
participant to the user 

m e ans for r e cord i ng th e part i c i pants, th e r e cord i ng i nc l ud i ng both aud i o 
and v i d e o s i gna l s; 

moans for determ i n i ng, us i ng th e r e cord i ng of th e part i c i pants i n 
conjunct i on w i th an automat e d fac i a l d e cod i ng syst e m, wh e th e r at le ast 
on e part i c i pant e xh i b i ts th e part i cu l ar e xpr e ss i on; and 
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m e ans for i d e ntify i ng th e at le ast on e part i c i pant who e xh i b i ts th e 
part i cu l ar e xpr e ss i on . 

16. (Currently amended) The apparatus of Claim 15 wherein the recorded 
video and audio s i gna l s data representing the at least one participant js 
af© passed through a cultural rog i ona l /cu l tura l filter to filter out 
expressions that are characteristic to a culture before the at least one 
participant is displayed to the user i d e nt i fi e d . 

17. (Currently amended) The apparatus of Claim 16 wherein the recorded 
video and audio s i gna l s data representing the at least one participant is 
further are passed through an individual filter to filter out expressions that 
are characteristic to the at least one participant before the at least one 
participant is displayed to the user i dont i fiod . 

18. Canceled. 

19. Canceled. 

20. (Currently amended) The apparatus of Claim [[19]] 17 wherein the 
i d e nt i fy i ng st e p i nc l ud e s th e st e p of d i sp l ay i ng an i mag e as w ell as a name 
and location of the at least one participant i nd i v i dua l are also displayed to 
the user . 

21. Canceled. 

22. (Currently amended) A system for automatically identifying participants at 
a conference who exhibit a particular expression during a speech 
comprising: 
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at least one storage system for storing code data; and 

at least one processor for processing tlie code data to receive from a user 
input data which specifies i nd i cat e the particular expression during the 
speech, and to identify whether at least one participant exhibits the 
particular expression during the speech, wherein to identify whether the at 
least one participant exhibits the particular expression includes to analyze 
data representing the participants to generate a set of action units (Alls) 
for each participant wherein each set of AUs for a participant represents 
an expression exhibited by the participant, to determine whether at least 
one of the participants exhibits the particular facial expression by 
processing each set of generated AUs utilizing an automated facial 
decoding system, and to display, in response to determining that one of 
the participants exhibits the particular facial expression, the at least one 
participant to the user record the porticipanto. tho record i ng i nc l ud i ng both 
aud i o and v i d e o s i gna l s, to d e term i n e , us i ng th e r e cord i ng of th e 
part i c i pants i n conjunct i on with an automat e d fac i a l d e cod i ng syst e m, 
wh e th e r at le ast one part i c i pant exh i b i ts th e part i cu l ar e xpr e ss i on, and to 
i d e nt i fy th e at le ast on e part i c i pant who e xh i b i ts th e part i cu l ar e xpr e ss i on . 

23. (Currently amended) The system of Claim 22 wherein the recorded video 

and audio s i gna l s data representing the at least one participant is are 
passed through a cultural r e g i ona l /cu l tura l filter to filter out expressions 
that are characteristic to a culture before the at least one participant is 
displayed to the user i d e nt i fi e d . 

24. (Currently amended) The system of Claim 23 wherein the recorded video 
and audio s i gna l s data representing the at least one participant is further 
are passed through an individual filter to filter out expressions that are 
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characteristic to the at least one participant before the at least one 
participant is displayed to the user i d e nt i fi e d . 

25. Canceled. 

26. Canceled. 

27. (Currently amended) The system of Claim [[26]] 24 wherein th e i d e nt i fy i ng 
st e p i nc l ud e s th e st e p of display i ng an imag e as w ell as a name and 
location of the at least one participant i nd i v i dua l are also displayed to the 
user. 

28. Canceled. 
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